Exact solutions for models of evolving networks with addition and deletion of nodes 
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There has been considerable recent interest in the properties of networks, such as citation networks 
and the worldwide web, that grow by the addition of vertices, and a number of simple solvable models 
of network growth have been studied. In the real world, however, many networks, including the 
web, not only add vertices but also lose them. Here we formulate models of the time evolution of 
such networks and give exact solutions for a number of cases of particular interest. For the case 
of net growth and so-called preferential attachment — in which newly appearing vertices attach to 
previously existing ones in proportion to vertex degree — we show that the resulting networks have 
power-law degree distributions, but with an exponent that diverges as the growth rate vanishes. 
We conjecture that the low exponent values observed in real-world networks are thus the result of 
vigorous growth in which the rate of addition of vertices far exceeds the rate of removal. Were 
growth to slow in the future, for instance in a more mature future version of the web, we would 
expect to see exponents increase, potentially without bound. 



I. INTRODUCTION 

The study of networks has attracted a substantial 
amount of attention from the physics community in the 
last few years HI S 13 > in part because of networks' broad 
utility as representations of real-world complex systems 
and in part because of the demonstrable successes of 
physics techniques in shedding light on networked phe- 
nomena. One topic that has been the subject of a par- 
ticularly large volume of work is growing networks jSuch 
as citation networks 0, ^ and the worldwide web [^ Q . 
Perhaps the best-known body of work on this topic is that 
dealing with "preferential attachment" models e, 9| , in 
which vertices are added to a network with edges that at- 
tach to preexisting vertices with probabilities depending 
on those vertices' degrees. When the attachment proba- 
bility is precisely linear in the degree of the target vertex 
the resulting degree sequence for the network follows a 
Yule distribution in the limit of large network size, mean- 
ing it has a power-law tail Q, M, Il0> Ull US ■ This case is 
of special interest because both citation networks and the 
worldwide web are observed to have degree distributions 
that approximately follow power laws. 

The preferential attachment model may be quite a 
good model for citation networks, which is one of the 
cases for which it was originally proposed H, [l^. For 
other networks, however, and especially for the world- 
wide web, it is, as many authors have pointed out, nec- 
essarily incomplete [l^, [3 HM LJI I13 • On the web there 
are clearly other processes taking place in addition to 
the deposition of vertices and edges. In particular, it is 
a matter of common experience that vertices (i.e., web 
pages) are often removed from the web, and with them 
the links that they had to other pages. Models of this 
process have been touched upon occasionally in the lit- 
erature [l^ il9j and the evidence suggests that in some 



cases vertex deletion affects the crucial power-law behav- 
ior of the degree distribution, while in other cases it does 
not. 

In this paper, we study the general process in which 
a network grows (or, potentially, shrinks) by the con- 
stant addition and removal of vertices and edges. We 
show that a class of such processes can be solved exactly 
for the degree distributions they generate by solving dif- 
ferential equations governing the probability generating 
functions for those distributions. In particular, we give 
solutions for three example problems of this type, having 
uniform or preferential attachment, and having station- 
ary size or net growth. The case of uniform attachment 
and stationary size is of interest as a possible model for 
the structure of peer-to-peer filesharing networks, while 
the preferential-attachment stationary-size case displays 
a nontrivial stretched exponential form in the tail of the 
degree distribution. Our solution of the preferential at- 
tachment case with net growth confirms earlier results 
indicating that this process generates a power-law dis- 
tribution, although the exponent of the power-law di- 
verges as the growth rate tends to zero, giving degree 
distributions that are numerically indistinguishable from 
exponential for small growth rates. This suggests that 
the clear power law seen in the real worldwide web is a 
signature of a network whose rate of vertex accrual far 
outstrips the rate at which vertices are removed. The 
relative rates of addition and removal could, however, 
change as the web matures, possibly leading to a loss of 
power-law behavior at some point in the future. 



II. THE MODEL 

Consider a network that evolves by the addition and 
removal of vertices. In each unit of time, we add a sin- 



gle vertex to the network and remove r vertices. When a 
vertex is removed so too are all the edges incident on that 
vertex, which means that the degrees of the vertices at 
the other ends of those edges will decrease. Non-integer 
values of r are permitted and are interpreted in the usual 
stochastic fashion. (For example, values r < 1 can be in- 
terpreted as the probability per unit time that a vertex is 
removed.) The value r = 1 corresponds to a network of 
fixed size in which there is vertex turnover but no growth; 
values r < 1 correspond to growing networks. In princi- 
ple one could also look at values r > 1, which correspond 
to shrinking networks, and the methods derived here are 
applicable to that case. However, we are not aware of 
any real- world examples of shrinking networks in which 
the asymptotic degree distribution is of interest, so we 
will not pursue the shrinking case here. 

We make two further assumptions, which have also 
been made by most previous authors in studying these 
types of systems: (1) that all vertices added have the 
same initial degree, which we denote c; (2) that the ver- 
tices removed are selected uniformly at random from the 
set of all extant vertices. Note however that we will not 
assume that the network is uncorrelated (i.e., that it is a 
random multigraph conditioned on its degree distribution 
as in the so-called configuration model). In general the 
networks we consider will have correlations among the 
degrees of their vertices but our solutions will nonethe- 
less be exact. 

Let pk be the fraction of vertices in the network at a 
given time that have degree k. By definition, pk has the 
normalization 



Y^Pk^i. 



(1) 



k=0 



Our primary goal in this paper will to evaluate exactly 
the degree distribution p^ for various cases of interest. 

Although the form of pk is, as we will see, highly 
nontrivial in most cases, the mean degree of a vertex 
{k) = X^fc^o ^P^ ^^ easily derived in terms of the parame- 
ters r and c. The mean number of vertices added to the 
network per unit time is 1 — r. The mean number of edges 
removed when a randomly chosen vertex is removed from 
the network is by definition {k) . Thus the mean number 
of edges added to the network per unit time is c — r{k). 
For a graph of m edges and n vertices, the mean degree 
is (k) — 2m/n. After time t we have n = (1 — r)t and, 
assuming that (fc) has an asymptotically constant value, 
TO = (c— r{k))t. Thus 



(fc)=2 



c — r{k) 



or, rearrangmg. 



(fc> = Y 



2c 



(2) 



(3) 



In the special case r = 1 of a constant-size network, this 
gives (fc) = c, which is clearly the correct answer. 



We must also consider how an added vertex chooses 
the c other vertices to which it attaches. Let us define 
the attachment kernel iTk to be n times the probability 
that a given edge of a newly added vertex attaches to a 
given preexisting vertex of degree k. The factor of n here 
is convenient, since it means that the total probability 
that the given edge attaches to any vertex of degree k 
is simply n^Pk- Since each edge must attach to a vertex 
of some degree, this also immediately implies that the 
correct normalization for ttj, is 



y^ TTfcPfc = 1. 



(4) 



fc=0 



For the particular case of tt^, oc A: and r < 1, which 
we consider in Section [ill CI models similar to ours have 
been studied previously b y C hung and Lu [I^] and by 
Cooper, Frieze, and Vera [13. The results reported by 
these authors are mostly of a different nature to ours, but 
there are some overlaps, which we discuss at the appro- 
priate point. 



A. Rate equation 

Given these definitions, the evolution of the degree dis- 
tribution is governed by a rate equation as follows. If 
there are at total of n vertices in the network at a given 
time then the number of vertices with degree k is npk- 
One unit of time later this number is (n -I- 1 — r)p'j. , where 
p'j, is the new value of pk ■ Then 

(n + 1 - r)p^. = npk + Skc + ciik-iPk-i ~ cukPk 

+ r{k + l)pk+i - rkpk - rpk- (5) 

The term dkc in Eq. (jSJ represents the addition of a vertex 
of degree c to the network. The terms cTTk-iPk~i and 
—CTTkPk describe the flow of vertices from degree fc — 1 
to k and from fc to fc -I- 1 as they gain extra edges when 
newly added vertices attach to them. The terms (fc -|- 
l)pk+i and —kpk describe the flow from degree fc-|- 1 to fc 
and from fc to fc — 1 as vertices loose edges when one of 
their neighbors is removed from the network. And the 
term —rpk represents the removal with probability r of 
a vertex with degree k. Contributions from processes in 
which a vertex gains or loses two or more edges in a single 
unit of time vanish in the limit of large n and have been 
neglected. 

We will be interested in the asymptotic form of pk in 
the limit of large times for a given TTfc. Setting p'j^ — pk 
in 10 gives 



Skc + CTTk-lPk-l - CTTkPk 

+ r{k + l)pk+i - rkpk 



Pk^O, 



(6) 



whose solution we can write in terms of generating func- 



tions as follows. Let us define 



readily determine that 



m - E 



T^kPkZ 



fc=0 



g{z) = ^Pk^ 



(7) 
(8) 



A:=0 



Then, upon multiplying both sides of J^Jl by 2*^ and sum- 
ming over k (with the convention that p_i = 0), we de- 
rive a differential equation for g{z) thus: 



ril-z)^^-g{z)-c{l-z)f{z) + z^ 



0. 



(9) 



Note also that we can easily generalize our model to the 
case where the degrees of the vertices added are not all 
identical but are instead drawn at random from some 
distribution r^. In that case, we simply replace Skc in 
Eq. @ with rfc and z"^ in Eq. (j^ with the generating 
function h{z) = J^k '''kZ^ ■ 

In the following sections we solve Eq. Q for a number 
of different choices of the attachment kernel tt^. Note 
that, since the definitions of both f{z) and g{z) incor- 
porate the unknown distribution pk , we must in general 
solve implicitly for g{z) in terms of f{z). In all of the 
cases of interest to us here, however, it turns out to be 
straightforward to derive a explicit equation for g{z) as 
a special case of ©• 



III. SOLUTIONS FOR SPECIFIC CASES 

In this section we study three specific examples of the 
class of models defined in the preceding section, namely 
linear preferential attachment models (Tr^ oc k) for both 
growing and fixed-size networks, and uniform attachment 
{-Kk = constant) for fixed size. As we will see, each of 
these cases turns out to have interesting features. 



A. Uniform attachment and constant size 

For the first of our example models we study the case 
where the size of the network is constant (r = 1) and in 
which each vertex added chooses the c others to which 
it attaches uniformly at random. This means that TTfc 
is constant, independent of fc, and, combining Eqs. (^ 
and Q, we immediately see that the correct normaliza- 
tion for the attachment kernel is Tr^ = 1 for all k. Then 
we have ir^pk = Pk so that /(z) — g{z) in ©, which gives 



j»M-S 



(10) 



Noting that (1 — z)e "^^ is an integrating factor and that 
g{z) must obey the boundary condition 17(1) = 1, we 



5W 



where 



e 



l-z 



fe-"' di 

(^+i)[r(c + i,cz)-r(c + i,c)], (11) 



T{c+l,x) 



f'e-* dt. 



(12) 



is the incomplete F-function. 

One can easily check that this gives a mean degree 
.g'(l) = c, as it must, and that the variance of the degree 
g"{l)+g'{l)—c^ is equal to |c, indicating a tightly peaked 
degree distribution. 

To obtain an explicit expression for the degree distri- 
bution, we make use of 



m=0 



F(c+l,x)=F(c+l)e--5:— , 
^ m!' 

00 

(i--r = E-'' 



(13) 
(14) 
(15) 



fe=o 



to write 

g{z) ^ c-(=+i) 

00 p C 



k=0 



CZ 



r{c + i,c)J2 



(czY 



(16) 



The z-dependence in the first term of this expression can 
be rewritten 



fe=0 m=0 



{czY 



EE 



ml 



7 1 



m—O k—m 
00 min(fc,c) 

fc=0 m=0 

cV^ j.F(min(fc,c) -I- l,c) 
^ ^^ F(min(fc,c) + 1) 



(17) 



where min(fc, c) denotes the smaller of k and c and we 
have again employed 113|l . A similar sequence of manip- 
ulations leads to an expression for the second term also, 
thus: 



00 00 

E-'^E 



-' ^ F(A; + 1) ■ ^ > 



Combining these identities with (|16|l . it is then a simple 
matter to read off the term in g{z) involving z*^, which 




FIG. 1; The degree distribution of our model for the case 
of uniform attachment (nk ~ constant) with fixed size n = 
50 000 and c — 10. The points represent data from numerical 
simulations and the solid line is the analytic solution. 



is by definition our pk ■ We find two separate expressions 
for the cases of k above or below c: 



Pk 



r<C+ 



^[r(c + i)-r(c + i,c)] 



r(fc + i,c) 
r(fc + i) ' 

for k < c. 



(19) 



and 



Pk 



f,C+ 



jT{c+l,c) 



1 



r(fc + i,c) 
r(fc + i) 



for k>c. (20) 



Note that the quantity r(fc + 1, c)/T{k + 1) appearing in 
both these expressions is the probability that a Poisson- 
distributed variable with mean c is less than or equal to k. 
Thus the degree distribution has a tail that decays as the 
cumulative distribution of such a Poisson variable, imply- 
ing that it falls off rapidly. To see this more explicitly, 
we note that for fixed c and fc 3> c 



Pk 



r(c+l,c) 



r.C+1 



y — 



in — k-\-l 



^±±lA^-c (21) 

r(fc + 2)^ ' ^ > 



since the sum is strongly dominated in this limit by its 
first term. Applying Stirling's approximation, r(a::) ~ 



(a;/e)^-\/27r/a;, this gives 



(22) 



which decays substantially faster asymptotically than 
any exponential. 

As a check on these calculations, we have performed 
extensive computer simulations of the model. In Fig. ^ 
we show results for the case c = 10, along with the exact 
solution from Eqs. (|19|) and (|20|l . As the figure shows, 
the agreement between the two is excellent. 



Before moving on to other issues, we note a different 
and particularly simple case of a growing network with 
uniform attachment, the case in which the vertices added 
have a Poisson degree distribution cJ'e^'^ /k\ with mean c. 
In that case the factor of z"^ in Eq. (|10l) is replaced with 
the generating function h{z) for the Poisson distribution: 



h(z) 



fc=0 



.^c{z-l) 



k\ 



and the solution, Eq. (|llll . becomes 



9{z) 



1 



h{t) e""* di = e' 



c{z-l) 



(23) 



(24) 



which is itself the generating function for a Poisson dis- 
tribution. Thus we see particularly clearly in this case 
that the equilibrium degree distribution in the steady- 
state uniform attachment network is sharply peaked with 
a Poisson tail. In fact, the network in this case is simply 
an uncorrelated random gra ph of the type famously stud- 
ied by Erdos and Renyi |23|. It is straightforward to see 
that if one starts with such a graph and randomly adds 
and removes vertices with Poisson distributed degrees, 
the graph remains an uncorrelated random graph with 
the same degree distribution, and hence this distribution 
is necessarily the fixed point of the evolution process, as 
the solution above demonstrates. 



B. Preferential attachment and constant size 

Our next example adds an extra degree of complexity 
to the picture: we consider vertices that attach to oth- 
ers in proportion to their degree, the so-called "prefer- 
ential attachment" mechanism |2|. This implies that our 
attachment kernel TTfc is linear in the degree, TTfe = Ak 
for some constant A. The normalization requirement Q 
then implies that 



E 

fe=0 



TTfcPfe 



AY,kpk ^ A{k) ^ 1, 



(25) 



k=0 



and hence A = l/{k). For the moment, let us continue 
to focus on the case r = 1 of constant network size, in 
which case (fc) — c (Eq. Q) and 



k 
TTfc = -. 
c 



Then 



^ CO 

f{z) "^ -^kp. 

r ^ — ^ 



•kz'^ = -g'{z), 

c '■ — ' c 

A:=0 



and Eq. becomes 



(l-z)2 dz (l-z)2 



(26) 



(27) 



(28) 



The appropriate integrating factor in this case is 
0-1/(1-^)^ which, in conjunction with the boundary con- 
dition g{l) = 1, gives 

g(z) = ei/(i-^)^'^^e-V(i-Odt. (29) 

Changing the variable of integration to y = 1/(1 — i) this 
expression can be written 

9iz) =ei/(i-^) r (l--) e-ydy 

Ji/{i-z) V yJ 



.1/(1-.) ^(_i). 



s=0 



■dy 



^s/ ./i/(i-z) y 
= i + eVa-^)^(-irQr(i-.,^).(30) 

where r(l — s,x) —J e^^y^^dy is again the incom- 
plete F-function, here appearing with a negative first ar- 
gument. 

A useful identify for the case s > 1 can be derived by 
integrating by parts thus: 



T{-s,x) = - 
s 



a;* 



(31) 



Iterating this expression then gives 



r(l-s,a:) = - 



(-ir 



D! 



s-1 



r(0,a;)+e--^ 



(-l)'"(m- 1)! 



(32) 



(r(0, x) ~ J {e'y /y) dy is also known as the exponen- 
tial integral function — Ei(— a;).) Applying this identity 
to l|Sn|l gives 

^ ^ rn—1 

= q(z)-A,ei/(i-^)r(^0,^^, (33) 

where q{z) is a polynomial of degree c — 1 and Ac — 
Ss=i ifj/i^ ~ !)■ depends only on c. For k > c, then, 
the degree distribution pk is given by the coefficients of z'^ 
in -Ac e^/(^"^) r(0, 1/(1 - z)). We determine these co- 
efhcients as follows. Changing the variable of integration 
to a: = y — 2:/(l — ^), we find 



.1/(1-^) ro 



l-z 



X + z/(l — z) 



■ dx. 



Then we expand the integrand to get 
1 ~" 



X + z/(l — z) X 






k=\ 



k~\ h 



X X^ 



(34) 



(35) 



J3 

CO 

O 
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FIG. 2: The degree distribution for our model in the case of 
fixed size n = 50 000 and c = 10 with linear preferential at- 
tachment. The points represent data from our numerical sim- 
ulations and the solid line is the analytic solution for k > c. 
Note that the tail of the distribution does not follow a power 
law as in growing networks with preferential attachment, but 
instead decays faster than a power law, as a stretched expo- 
nential. 



Commuting the sum and the integral, we obtain 

_el/a-)F(o,-^)=f;a,z^ (36) 

where 



ao = -e / da; = -eF(0,l), (37) 

/i X 



and for fc > 1 

ak = e I I 1 



1 \ e 



■da;. 



(38) 



1 1 \ X 1 X 

Integrating by parts, we obtain a slightly simpler expres- 



ak 



1 



'da;. 



(39) 



While the coefficients a^ can be expressed exactly us- 
ing hypergeometric functions, a perhaps more informa- 
tive approach is to employ a saddle-point expansion. The 
integrand of (|39|l is unimodal in the interval between 1 
and oo, and peaks at a: = i(l-|--\/4fc"+T) ~ vk. Approx- 
imating the integrand as a Gaussian around this point, 
we obtain as A; — > oo 



a-k 



ire k 



-3/4g-2Vfe 



(40) 



and pfe — Ac a^. for A; > c as stated above. 

Figure [21 shows the form of this solution for the case 
c = 10. Also shown in the figure are results from 



computer simulations of the model on systems of size 
n = 50 000 with c = 10, which agree well with the ana- 
lytic results. The appearance of the stretched exponen- 
tial in Eq. (|40|) is worthy of note. We are aware of only 
a few cases of graphs with stretched exponential degree 
distributions that have been discussed previously, for in- 
stance in growing networks with sublinear preferential 
attachment |2l| as well as in empirical network data [221 . 



is |(a-z)/(l- z)| ^^'^ ''-' where a = 2r/(l + r). (Note 
that a < 1 when r < 1.) Unfortunately, this integrating 
factor is non-analytic at z = a, which makes integrals 
traversing this point cumbersome. To circumvent this 
difhculty, we observe that the second term in Eq. H42|) 
vanishes at z = a, giving g{a) = a'^. This provides us 
with an alternative boundary condition on g{z), allowing 
us to fix the integrating constant while only integrating 
up to z = a. It is then straightforward to show that 



C. Preferential attachment in a grow^ing network 

We now come to the third and most complex of our ex- 
ample networks, in which we combine preferential attach- 
ment with net growth of the network, r < 1 . (Logically, 
we should perhaps first solve the case of a growing net- 
work without preferential attachment, which in fact we 
have done. But the solution turns out to have no quali- 
tatively new features to distinguish it from the constant 
size case and is mathematically tedious besides. Given 
the large amount of effort it requires and its modest re- 
wards, therefore, we prefer to skip this case and move on 
to more fertile ground.) 

As before, perfect linear preferential attachment im- 
plies TTfc = k/{k) or 



k 



TTfe 



^ki^ + r)-, 



(41) 



9i^) 



1-zj 



l-t 



fdt 



{l^t){a-t)' 



(43) 



for z < a. Since the degree distribution is entirely deter- 
mined by the behavior oi g{z) at the origin, it is adequate 
to restrict our solution to this regime. 

Changing variables io u = [a — t)/{\ — a), we find 



9{z) 



1-7 



(1 



[a — (1 — a)u]' 



du 



(44) 



1 + u/ " " u^ 

where 7 == (3 — r)/{l — r). If we expand the last factor 
in the integrand, this becomes 



where we have made use of Eq. ^. Then /(z) = (1 
r)zg'{z)/2c and Eq. Q becomes 



<7(z)-(l-z)[r-i(l + r)z 



dg 
dl 



(42) 



An integrating factor for the left-hand side in this case 

I 

We observe the following useful identity: 

(1 + uf-^ du = 



T, ^ du — 

(1 + ")^ JO 



1 + u 



w-Ti7B-ir:a-")- 



1-z 



1-7 



,'*+7-2 



(1+u)- 



du. (45) 



a 



(/3-7+l)(l-Fa;)^-i /3 - 7 -f 1 7o (1 + u)t 



,/3-i 



du. 



(46) 



where the second equality is derived via integration by parts. Setting /3 = s -I- 7 — 2 and x = (a — z)/(l — a) and 
noting that the last integral has the same form as the first, we can employ this identity iteratively s — \ times to get 



a-z\^-^ r^^ „s+7-2 ^^^^_^^,+ir(. + 7-l) 







(1 + u) 



7 



r(.) 



1 



1-7 



r(7)Vi-^/ JO 
r 



,7-1 



(i + u)' 



d"+E 



(-1)'^ 



' r(7 + m) \ 1 — z 



(47) 



The final sum can be evaluated in closed form in terms 
of the incomplete F-function, but our primary focus here 
is on the preceding term. Substituting into Eq. H45|) . we 



see that g[z) = q{z) + Ac^rhiz), where 



M^)=-(^^)'"r''..^^du, 



l-z 







(l + u)^ 



(48) 



A — 



s=0 



{I -ay 



c-.r(7- 



1) 



r(7)r(s) 



(49) 



and q{z) is a polynomial of order c — 1 in z. 

Since Ac^r depends only on c and r and q{z) has no 
terms in z of order z"^ or higher, the degree distribution 
for fc > c is, to within a multiplicative constant, given 
by the coefficients in the expansion of h{z) about zero. 
Making the change of variables 



y 



(l-z)/(a-z)-y' 



we find that 



Hz) = - 



y 



''-^dy 



(l-2)/(a-^)-y' 



(50) 



(51) 



and expanding the integrand in powers of z we obtain 
h{z) = J2kLo o.kZ^ with 



flfc = (1 - a) 



' (1-y) 



fc-i 



{\-ayY+^ 



y'^ My 



y^ ay, 



k 



I -ay 



(52) 



for A: > 1, where the second equality follows via an inte- 
gration by parts. 

As in the case of constant size, we can express these 
coefficients in closed form using special functions, but if 
we are primarily interested in the form of the tail of the 
degree distribution then a more revealing approach is to 
make a further substitution y — x/fc, giving 



flfc = (7 - l)fc" 



{l-x/kf 



Iq (1 — ax/kY 
In the limit of large k this becomes 



c''-2 dx. 



(53) 



Ofc ~ (7-l)/c-'^ / e-(i-")^a;'^"2 ^x 

r(7) 



{I -a) 



7-1 



k-\ 



(54) 



and pk = Ac.r ak for fc > c as stated above. 

Thus the tail of the degree distribution follows a power 
law with exponent 7 = (3 — r)/(l — r). Note that this 
exponent diverges as r ^ 1 so that the power law be- 
comes ever steeper as the growth rate slows, eventually 
assuming the stretched exponential form of Eq. (|40|l — 
steeper than any power law — in the limit r — \. In the 
limit r — > we recover the established power-law be- 
havior ak ^ k~^ for growing graphs with preferential 
attachment and no vertex removal [a 0, Hol Hlf . 

In Fig. 13 we show the form of the degree distribution 
for this model for the case ?' = i, c = 10, along with 
numerical results from simulations of the model on net- 
works of (final) size n = 100 000 vertices. The power-law 
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FIG. 3: Degree distribution for a growing network with linear 
preferential attachment and r — i, c = 10. The solid line 
represents the analytic solution, Eqs. 1491 . and 15211 . for k > c 
and the points represent simulation results for systems with 
final size n = 100 000 vertices. 



behavior is clearly visible on the logarithmic scales used 
as a straight line in the tail of the distribution. Once 
again the analytic solution and simulations are in excel- 
lent agreement. 

We note that Chung and Lu jl^l and Cooper, Frieze, 
and Vera 19] have independently demonstrated power- 
law behavior in the degree distribution of growing net- 
works, using models similar to ours. Their results are 
asymptotic approximations describing the tail of the dis- 
tribution, rather than exact solutions, but they find the 
same dependence of the exponent on the growth rate. 



IV. DISCUSSION 

In this paper we have studied models of the time evo- 
lution of networks in which, in addition to the widely 
considered case of addition of vertices, we also include 
vertex removal. We have given exact solutions for cases 
in which vertices are added and removed at the same rate, 
a potential model for steady-state networks such as peer- 
to-peer networks, and cases in which the rate of addition 
exceeds the rate of removal, which we regard as a simple 
model for the growth of, for example, the worldwide web. 

We find very different behaviors in these various cases. 
For a steady-state network in which newly added vertices 
attach to others at random we find a degree distribu- 
tion, Eqs. (|19|l and (|20|l . which is sharply peaked about 
its maximum and has a rapidly decaying (Poisson) tail. 
This distribution is quite unlike the right-skewed degree 
distributions found in many real- world networks, but as a 
possible form for a "designed" network such as a peer-to- 
peer network it might be preferable over skewed forms, 
being more homogeneous and hence distributing traffic 
more evenly. 
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If newly appearing vertices attach to others using a hn- 
ear preferential attachment mechanism, whereby vertices 
gain new edges in proportion to the number they already 
possess, we find that the degree distribution becomes a 
stretched exponential, Eqs. (|39|l and (|40|l . a substantially 
broader distribution than that of the random attachment 
case, though still more rapidly decaying than the power 
laws often seen in growing networks. 

And in the case where the network shows net growth, 
adding vertices faster than it loses them, we find that 
the degree distribution follows a power law, Eqs. l(S^ 
and (|54|l , with an exponent 7 that assumes values in the 
range 3 < 7 < cxd, diverging as the growth rate tends to 
zero. 

This last result is of interest for a number of reasons. 
First, it shows that power-law behavior can be rigorously 
established in networks that grow but also lose vertices. 
Most previous analytic models of network growth have 
focused solely on vertex addition. And while the real 
worldwide web and other networks appear to have de- 
gree distributions that closely follow power laws, these 
networks also clearly lose vertices as well as gaining them. 
The results presented here demonstrate that the widely 
studied mechanism of preferential attachment for gener- 
ating power-law behavior also works in this regime. 

On the other hand, the large values of the exponent 7 
generated by our model appear not to be in agreement 
with the behavior observed in real-world networks, most 
of which have exponents in the range from 2 to 3 [llQ,|^. 
There are well-known mechanisms that can reduce the 
exponent from 3 to values slightly lower — specifically the 
generalization of the preferential attachment model to 
the case of a directed network [^ [ll|, which is in any 
case a more appropriate model for the worldwide web. 
In the limit of low growth rate, however, our model pre- 
dicts a diverging exponent and, while the exact value may 



not be accurate because of a host of complicating factors, 
it seems likely that the divergence itself is a robust phe- 
nomenon; as other authors have commented, there are 
good reasons to believe that net growth is one of the fun- 
damental requirements for the generation of power-law 
degree distributions by the kind of mechanisms consid- 
ered here. 

Thus the fact that we do not observe very large ex- 
ponents in real networks appears to indicate that most 
networks are in a regime where growth dominates over 
vertex loss by a wide margin. It is possible however that 
this will not always be the case. The web, for example, 
has certainly being enjoying a period of very vigorous 
growth since its appearance in the early 1990s, but it 
could be that this is a sign primarily of its youth, and that 
as the network matures its size will grow more slowly, 
the vertices added being more nearly balanced by those 
taken away. Were this to happen, we would expect to see 
the exponent of the degree distribution grow larger. A 
sufficiently large exponent would make the distribution 
indistinguishable experimentally from an exponential or 
stretched exponential distribution, although we do not 
realistically anticipate seeing behavior of this type any 
time in the near future. 
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